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Abstract 

Bit error rate (BER) minimization and SNR-gap maximization, two robustness optimization problems, are 
solved, under average power and bit-rate constraints, according to the waterfiUing policy. Under peak-power 
constraint the solutions differ and this paper gives bit-loading solutions of both robustness optimization 
problems over independent parallel channels. The study is based on analytical approach with generalized 
Lagrangian relaxation tool and on greedy-type algorithm approach. Tight BER expressions are used for 
square and rectangular quadrature amplitude modulations. Integer bit solution of analytical continuous bit- 
rates is performed with a new generalized secant method. The asymptotic convergence of both robustness 
optimizations is proved for both analytical and algorithmic approaches. We also prove that, in conventional 
margin maximization problem, the equivalence between SNR-gap maximization and power minimization 
does not hold with peak-power limitation. Based on a defined dissimilarity measure, bit-loading solutions 
are compared over power line communication channel for multicarrier systems. Simulation results confirm 
the asymptotic convergence of both allocation policies. In non asymptotic regime the allocation policies 
can be interchanged depending on the robustness measure and the operating point of the communication 
system. The low computational effort of the suboptimal solution based on analytical approach leads to a 
good trade-off between performance and complexity. 

Index Terms 

Adaptive modulation, Gaussian channels, optimization methods, orthogonal design, resource manage- 
ment, robustness 

I. Introduction 

IN TRANSMITTER design, a problem often encountered is resource allocation among multiple independent 
parallel channels. The resource can be the power, the bits or the data and the number of channels. The 
allocation policies are performed under constraints and assumptions, and the independent parallel channels 
can be encountered in multitone transmission or multiantenna communications. 

Independent parallel channels result from orthogonal design applied in time, frequency or spatial domains 
[l]. They can either be obtained naturally or in a situation where the transmit and receive strategies are to 
orthogonalize multiple waveforms. Orthogonal frequency- division multiplexing (OFDM) and digital multitone 
(DMT) are two successful commercial applications for wireless and wireline communications with orthogonality 
in the frequency domain. In multiantenna communications, the parallel channels are made from the singular 
vectors of the multiple- input multiple-output (MIMO) channel [2]. This MIMO concept and the resulting 
orthogonal design can be applied in many communication scenarios when there are multiple transmit and 
receive dimensions f3^. 

To perform allocation, mathematical relations between various resources are needed and the first one is the 
channel capacity. This capacity of n independent parallel Gaussian channels is the well-known sum of the 
capacities of each channel 

n n 

C = EC» = Elog2(l + snr,). (1) 

j=l i=l 
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This relation, which holds for memoryless channels, links the supremum bit-rate Ci, here expressed in bit per 
two dimensions, to the signal to noise ratio, snr^, experienced by each channel or subchannel i. Any reliable 
and implement able system must transmit at a bit-rate below capacity Ci over each subchannel and then 
the margin, or SNR-gap, 7j is introduced to analyze such systems |4], [5] 

~ 2*"' — 1 ' ^^"^ 

This SNR-gap is a convenient mechanism for analyzing systems that transmit below capacity, and 

/ snr,\ , , 

r, = log2(l+^ , 3 

with ri the bit-rate in bits per two dimensional-symbol (bits per second per subchannel) which is also the 
number of bits per constellation symbol. 

Resource allocation is performed using loading algorithms and diverse criteria can be invoked to decide 
which portion of the available resource is allocated to each of the subchannels. From information theory point 
of view, the criterion is the mutual information and the optimal allocation under average power constraint was 
first devised in |!6 for Gaussian inputs and later for non-Gaussian inputs |7j . Since the performance measure is 
the mutual information in these cases, the SNR-gap in ([s]) is {7i}"=i = 1- In other cases, {7i}"=i > 1 and Q, as 
enhanced relationships, leads to many optimal and suboptimal allocation policies. In fact, resource allocation 
is a constraint optimization problem and generally two cases are of practical interest: rate maximization (RM) 
and margin maximization (MM), where the objective is the maximization of the data or bit-rate, and the 
maximization of the system margin (or power minimization in practice), respectively [s]. The MM problem 
gathers all non RM problems including power minimization, margin maximization (in its strict sense) and other 
measures such as error probabilities or goodpul]^ Among all the resource allocation strategies, equivalence or 
duality can be found defining family of approaches and using unified processes ^9]-[l2]. The loading algorithms 
are also split in two families. The first is based on greedy- type approach to iteratively distribute the discrete 
resources 13 , and the second uses Lagrangian relaxation to solve continuous resource adaptation 14 . Both 



approaches have been compared in terms of performance and complexity 9 , 14 - 16 . All these adaptive 



resource allocations are possible when channel state information (CSI) is known at both transmitter and 
receiver sides. This CSI can be perfect or imperfect, and full or partial. The effects of channel estimation error 
and feedback delay on the performance of adaptive modulated systems can also be considered in the allocation 
process 
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In this paper we shall focus henceforth on MM problems with perfect and full CSI consideration, and under 
peak-power and bit-rate constraints. It is assumed that the channel estimation is perfect, and feedback CSI 
delay and overhead are negligible. Peak-power constraint results from power mask limitation and has been 



taken into account in resource allocation problem [15] , 20-22 instead of the conventional average power 
constraint, or sum power constraint, which is historically the first considered constraint [g]. Bit-rate constraint 
comes from communication applications or service requirements, where different fiows can exist but one of 
them is chosen at the beginning of the communication. In this configuration, the remaining parameter to 
optimize is then the SNR-gap 7^ which is also related to the error probability of the communication system. 

Two similar problems of MM have the same objective that is to maximize the system robustness. What we 
call robustness in this paper is the capability of a system to maintain acceptable performance with unforeseen 
disturbances. 

The first measure of robustness is the SNR-gap, or system margin, and its maximization ensures protection 
to unforeseen channel impairments or noise. The system margin maximization is the maximization of the 
minimal SNR-gap 7^ in ([s]) over the n subchannels. In that case the conventional equivalence between margin 
maximization and power minimization in MM problems is not generally true. In this paper we show that this 
equivalence can nevertheless be obtained in particular configurations. 

The second robustness measure is the bit error rate (BER) and its minimization can reduce the packet 
error rate and the data retransmission. In transmitter design, the BER minimization can be realized using 



^In this paper MM abbreviation is related to the general family of non RM problems and not only to the margin maximization 
problem in its strict sense. The expanded form is reserved for the margin maximization in its strict sense. 
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uniform bit- loading and adaptive precoding [23], [24]. Analytical studies have been performed with peak-BER 
or average BER (computed as arithmetic mean) approaches [l7], [l9]. With average BER computed as weighted 
arithmetic mean, the resource allocation has been performed using greedy-type algorithm [25J . The first main 
contribution in this paper is the analytical solution of the resource allocation problem in the case of weighted 
arithmetic mean BER minimization. 

To perform the analytical study based on generalized Lagrangian relaxation tool, we develop a new method 
for finding roots of functions. This method generalizes the secant method to better fit the function-depending 
weight and to speed up the search of the roots. Both robustness polices are compared with a new measure that 
evaluates the difference in the bit distribution between two allocations. We also prove that both robustness 
policies provide the same bit distribution in asymptotic regime and this is the second main contribution in this 
paper. The proof is given in the case of unconstrained modulations (i.e. continuous bit-rates and analytical 
solution) and also for QAM constellations and greedy-type algorithms. The convergence is exemplified by 
simulation in multicarrier PLC (power line communications) systems. 

The organization of the paper is as follows. In Section [TTJ the quantities to be used throughout the paper are 
introduced and the robustness optimization problem is formulated in a general way for both system margin 
maximization and BER minimization. The cases of equivalence between margin maximization and power 



minimization are worked out. Section III is an interlude, presenting the considered expressions of accurate 



BER, a new measure of allocation differences and a new search method of root function. The solution of 



formulated problems are given in Section IV in the form of an optimum allocation policy based on greedy- 
type algorithms. The conditions of equivalence of both margin maximization and BER minimization are 
given in this section. Section IV] presents the analytical solution and both greedy- type and analytical methods 



are compared in Section VI In turn. Section VII exemplifies the application of robustness optimization to 
multicarrier PLC systems. Finally, the paper concludes in Section |VIII| with the proofs of several results 
relegated to the appendices. 

Notation. The bit-rates {ri}^^i are defined as a number of bits per two dimensions and they also could only 
be a number of bits (undertone per constellation). Without confusing, the unit of the variable are not all 
the time fully expressed. 

II. Problem formulation 
Consider n parallel subchannels. On the ztli subchannel, the input-output relationship is 

= kA + Wi , (4) 

with Si the transmitted symbol, Yi the received one, and hi the complex scalar channel gain. The complex 



Gaussian noise Wi is a proper complex random variable with zero-mean and variance equal to o"? 



The conventional average power constraint is 

1 " 

8 = 1 

whereas the peak-power constraint, or power spectrum density constraint, considered in this paper is 

yi€[l,n] E[\S,\^]<P. (6) 
It is convenient to use normalized unit-power symbol {Xi}"^-,^ such that 

5, = VpJ^Xi , (7) 

which leads to the peak-power constraint 

VzG[l,n] pi<l. (8) 

It is also convenient to introduce two other variables. The first one is the conventional SNR 

p 

smi = \hi\'^pi^- (9) 



a- 
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and the second is called power spectrum density noise ratio (PSDNR) 

1 " P 

psdnr = - l/iip^^ , (10) 

which is the mean signal to noise ratio over the n subchannels if and only if Vi = 1. This PSDNR is the 
ratio between the power mask at receiver side (the transmitted power mask through the channel) and the 
power spectrum density of the noise. The system performance will be given according to this parameter to 
point out the ability of a system to exploit the available power under peak-power constraint. 
Using the previous notations, ^ becomes 

With Pi/^i = 1 for all i, is the subchannel capacity under power constraint P. With unconstrained 
modulations, is defined in M, but constrained modulations are used in practice and takes a finite 
number of nonnegative values. Non integer number of bits per symbol can also be used with fractional bit 



^ log2 ( 



constellations 26 , 27 . In this paper, modulations defined by discrete points are used with integer number of 
bits per symbol. Typically, G {0,/3,2/3, • • • ,rniax}, where /3 is the granularity in bits and rmax is the number 
of bits in the richest available constellation. When all QAM constellations are used (3 = 1. The peak-power 
and bit-rate constraints are then 

n 

Vi p. < 1, ^ r, = i?, Vz r, e {0,/3,2/3, • • • , w} • (12) 

i=l 

Obviously, the exploitation of available power leads to Wi pi = 1 and the constraint is simplified 

n 

Y,ri = R, yi r, £ {0,/3,2/3, • • • , w} • (13) 

i=l 

With peak-power and bit-rate constraints, the allocation strategy is then to use all available power and to 
optimize the robustness. 

The problem we pose is to determine the optimal bit-rate allocation {r*}"^^ that maximizes a robustness 



measure, or inversely minimizes a frailness measure, with given SNR of subchannels while satisfying (13). In 
its general form, this problem can be written as 

[^ir-- =argmm(^({ri}^^i), (14) 

where (/>(•) is the frailness measure. In this paper, this measure is given by the SNR-gap or the BER. In 
addition to the bit-rate allocation, the receiver is presumed to have knowledge of the magnitude and phase of 
the channel gain whereas the transmitter needs only to know the magnitude {|/ii|}iLi- The objective 

is to find the data vector [rj, • • • , r*] which is the final relevant information for the transmitter. The allocation 
can then be computed on the receiver side to reduce the feedback data-rate from n real numbers to n finite 
integer numbers. Furthermore, the integer nature of the data-rates allows a full CSI at the transmitter which 
is not possible with real numbers. 

A. System margin maximization 

The SNR-gap 7^ of the subchannel i is ([s]) 

With reliable communications, 7^ is higher than 1 for all subchannels. Let the system margin, or system 
SNR-gap, be the minimal value of the SNR-gap in each subchannel 

7 = min ji . (16) 

i 

Let 7init be the initial system margin of one communication system ensuring a given QoS. Let 7 be the 
optimized system margin of this system. Then, the system margin improvement ensure system protection in 
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unforeseen channel impairment or noise, e.g. impulse noise: bit-rate and system performance targets are always 
reached for an unforeseen SNR reduction of 7/7init over all subchannels. This robustness optimization does 
not depend on constellation and channel coding types. The system margin 7 is defined and optimized without 
knowledge of used constellations and coding, and the proposed robustness optimization works for any coding 
and modulation scheme. 

The objective is the maximization of the system margin which is equivalent to the minimization of 7"^. We 
note 7i(ri) the function that associates to 7^. The function (/){■) in (14) is then given by 

<Af{^ar=i) =max^ (17) 



and 



arg mm max 7- 



(18) 



This problem is the converse problem of bit-rate maximization under peak-power and SNR-gap constraints. 
The solution of the bit-rate maximization problem is obvious under the said constraints and given by 

Vi r* = ;3[ilog2(l + ^)J. (19) 

Following the conventional SNR-gap approximation [4j, symbol error rate (SER) expression of QAM de- 
pending on SNR-gap is constellation size-independent with 

f3 



Mvi seri(ri) = 2erfc 




where the complementary error function is usually defined as 

2 



erfc [x) 



(20) 



(21) 



The system margin maximization is then equivalent to the peak-SER minimization in high SNR regime. 



Note that with (16), the system margin maximization can also be called a trough-SNR-gap maximization 
and it strongly related to the peak-power minimization. Whereas the bit-loading solution is the same for 
power minimization and margin maximization, with sum-margin or sum-power constraints instead of peak 
constraints, the following lemma gives sufficient conditions for equivalence in the case of peak constraints. 

Lemma 1: The bit allocation, that maximizes the system margin under peak-power constraint {p™^'^^™}"=i, 
minimizes the peak-power under SNR-gap constraint {7f°™'^}iLi if p™^''S™-yP°™'' = q/ for all i. 

Both problems have the same expression and therefore 

□ 



Proof: It is straightforward using (11) and (18 
the same solution. 

This lemma provides a sufficient but not necessary condition for the equivalence of solutions, and it says 
that if the power and the SNR-gap constraints have proportional distributions for margin maximization and 
peak-power minimization problems, respectively, then both problems have the same optimal bit-rate allocation. 
This lemma also shows that both problems don't have the same solution in a general case. A particular case 
is the uniform distribution of {pij^Li which is the case analyzed in this paper. 



B. BER minimization 

In communication systems, the error rate of the transmitted bits is a conventional robustness measure. By 
definition, the BER is the ratio between the number of wrong bits and the number of transmitted bits. With 
a multidimensional system, there exists several BER expressions 17 , 25 . Let the BER evaluated over the 
transmission of m multidimensional symbol^ In our case, the multidimensional symbols are the symbols sent 



■^We suppose that m is high enough to respect the ergodic condition and to make possible use of error probabihty. 
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over n subchannels. Let the number of erroneous bits received over subchannel i during the transmission. 
The BER is then given as 

n n 

ber=^^ = ^^^ . (22) 

i=l i=l 

The BER over subchannel i is ei/mvi and the BER of n subchannels is then 

n 

ber({rar=i) = ■ (23) 

The BER of multiple variable bit-rate is then not the arithmetic mean of BER but is the weighted mean 
BER. Weighted mean BER and arithmetic mean BER are equal if Vi, j = rj or if ber^ = for all i. As 
there exists ber,, 7^ then weighted mean BER and arithmetic mean BER are equal if and only if V^, j Ti = rj. 



Note that if the number m of transmitted multidimensional symbols depend on the subchannel i, (23) does 
not hold anymore. 



The function (f){-) in (14) is then given by 



and 



1 

<^({^ar=i) = ;^E'^»ber,(r,) (24) 

1=1 

[rJ, •••,<] = argmmber({rJ7^i) . (25) 

To simplify notations, let ber(i?) the BER of the system. In high SNR regime with Gray mapping, riberi(rj) = 
serj(ri) and then weighted mean BER can be approximated by arithmetic mean SER divided by the number 
of transmitted bits. 

Contrary to system margin maximization, the BER minimization needs the knowledge of constellation and 
coding schemes and it is based on valid expressions of BER functions. In this paper, the used constellations 
are QAM and the optimization is performed without channel coding scheme. When dealing with practical 
coded systems, the ultimate measure is the coded BER and not the uncoded BER. However, the coded BER 
is strongly related to the uncoded BER. It is then generally sufficient to focus on the uncoded BER when 
optimizing the uncoded part of a communication system l28i . 



III. Interludes 

Before solving the optimization problem, the BER approximation of QAM is presented. This approximation 
plays a chief role in BER minimization, a good approximation is therefore needed. Since this paper deals 
with bit-rate allocation, a measure of difference in the bit-rate distribution is proposed and presented in this 
section. This section also presents a new research method of root function. This method generalizes the secant 
method and converges faster than the secant one. 

A. BER approximation 

Conventionally, the BER approximation of square QAM has been performed by either calculating the symbol 



error probability or by simply estimating it using lower and upper bounds 29 . This conventional approximation 
tends to deviate from its exact values when SNR is low and it cannot be applied for rectangular QAM. Exact 
and general closed-form expressions are developed in [3^ for arbitrary one and two-dimensional amplitude 
modulation schemes. 

An approximate BER expression for QAM can be obtained by neglecting the higher order terms in the 



exact closed-form expression 30 
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Fig. 1. Exact BER curves and approximations |26| 



with li = 2L'''/^J , Jj = 21^^'/^^ and = log2(/i • Ji). By symmetry, li and can be inverted. The BER can also 
be expressed using the SNR-gap 7^. Using ([s]) and (26), the BER is written as 



ber^ — 




(27) 



These two approximations allow extension of the her i{ri) function from N to M+ which is useful for analytical 
studies. Fig. [T] gives the theoretical BER-curves and the approximated ones from the binary phase shift keying 
(BPSK) to the 32768-QAM. For BER lower than 5 -10"^ the relative error is lower than 1 % for all modulations. 



B. Dissimilar allocation measure 

To measure the difference in the bit distribution between different allocation strategies, we need to evaluate 
the dissimilarity. This dissimilarity measure must verify the following properties: 1) if two allocations lead to 
the same bit distribution then the measure of dissimilarity must be null, whereas 2) if two allocations lead 
to two completely different bit distributions in loaded subchannels, then the measure of dissimilarity must 
be equal to one, and 3) the measure is symmetric, i.e. the dissimilarity between allocation X and allocation 
Y must be the same as the dissimilarity between allocation Y and allocation X. We choose that the empty 
subchannels do not impact the measure. 
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Definition 1: The dissimilarity measure between allocation X and allocation Y is 

n 

Y,5[n{X)~n{Y)) 
n{x, Y) = '-^ , 

where b{x) = 1 if a; 7^ else b{x) = 0. 

This dissimilarity has the following properties. 
Property 1: ^i{X,Y) = iff V^, ri{X) = ri{Y). 

Property 2: IJ,{X, F) = 1 iff \/i then ri{X) 7^ ri(Y) or ri{X) = ri{Y) = 0. 
Property 3: fi{X,Y) = fi{Y,X). 

Property 4-' If ^(^, ^) = 0, then for all allocation Z, fi{X, Z) = fi{Y, Z). 

All these properties are direct consequences of Definition [T] For a null dissimilarity, Y) = 0, all the 
subchannels transmit the same number of bits, i.e. ri{X) = ri(Y). For a full dissimilarity, n{X, Y) = 1, all 
the non empty subchannels of both allocations X and Y transmit a different number of bits, i.e. Vz such as 
ri{X) 7^ and ri{Y) 7^ then ri{X) 7^ ri{Y). It is obvious that the measure is symmetric ^{X,Y) = ji{Y^X). 
If two allocations have a null dissimilarity ^{X, Y) = 0, then they are identical and for any allocation Z 
fi{X,Z) = fi{Y,Z). The converse of this last property is not true. Note that the dissimilarity is not defined 
for two empty allocations. 

Forexample, letn = 4and[ri(X),-- - ,r^{X)] = [4 3 3 0]. If [ri(y), • • • ,ri{Y)] = [3 2 2 2] or [ri(F),-- - ,ri{Y)] = 
[5 5 0] then ^(X, Y) = 1. If [ri{Y), • • • , ri{Y)] = [4 3 2 1] then fi{X, F) = |. The measure fi{X, Y) is nuU if 
and only ff [ri(y), - •• ,r4(F)] = [4 3 3 0]. 



C. Generalized secant method 

There are many numerical methods for finding roots of function. We propose a new method, called gen- 
eralized secant method that is based on secant method. This new method better fits the function-depending 
weight than secant method to speed the convergence. Before explaining this new method, a brief overview of 
secant method is given. 

In our case, the objective function f{x) is monotonous, non differentiable and computable over x G [a;i,a;2] 
with 177^4, = — /S^^li ■ The secant method is as follows for an increasing function f(x). 

\fixi)\ \f(X2)\ *= ^ ^ 

1) i = 0, yo = f{xi); 

o\ TP I 1^,1 • ,1 , r r/ \ 1 I Vi+1 < then xi = xq \ . . ^ , 

3 it iVi+i — % < e then xn is the root of fix), else < > , i ^ i + 1 and go to step 2. 

' ' [ yi+i > then X2 = xo J 

The objective of the secant method is to approximate f{x) by a linear function gi{x) = aix + bi at each 
iteration i, with gi{xi) = f{xi) and gi{x2) = f{x2), and to set xq as the root of gi{x). The search for the root 
of f{x) is completed when the desired precision e is reached. The precision is given for yi but it can also be 
given for Xi. 

As the function f{x) is computable, it can be plotted and an a posteriori simple algebraic or elementary 
transcendental invertible function over [xi,X2] can be used to better fit the function /(x). An a posteriori 
information is then used to improve the search for the root. The function f{x) is iteratively approximated by 
aih{x) + bi instead of a^x -|- bi, where h{x) is the invertible function. This method is then given as follows for 
an increasing function f{x). 

1) i = 0, j/o = f{xi)] 

o\ TP I 1^,1 ■ ,1 , r \ 1 I Vi+1 < then xi = Xq \ . . . . 

3 if hy,-i-i —Vi\ < e tlien xn is tiie root of fix , else < ^ , >,-«— s-z+l and go to step 2. 

' ^ ' \ t/i+i > then X2 = Xo J' ^ ^ 

Compared to secant method, only step 2) differs from generalized secant method where the computation of 
Xq is performed taking into account the approximated shape h{x) of the function /(x). 
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This generalized secant method is used in Section |V] to find the root of the Lagrangian and is compared to 
the conventional secant method. In our case, f{x) is the sum of logarithmic functions and the function h{x) 
is then the logarithmic one. 

IV. Optimal greedy-type allocations 

The general problem is to find the optimal allocation [r^, • • • , r*] that minimizes 4>{-), the inverse robustness 
measure, or frailness. This is a combinatorial optimization problem or integer programming problem. The core 
idea in this iterative allocation is that a sequential approach can lead to a globally optimum discrete loading. 
Greedy-type methods then converge to optimal solution under conditions. Convexity is not required for the 
convergence of the algorithm and monotonicity is sufficient [3l]. This monotonicity ensures that the removal 
or addition of /3 bits at each iteration converges to the optimal solution. In this paper the used functions (/>(•) 
are monotonic increasing functions. 

In its general form and when the objective function (p(-) is not only a weighted sum function, the iterative 
algorithm is 

1) Start with allocation [ri'\ ■ ■ ■ ,rn^] = 0, 

2) fc = 0, 

3) Allocate one more bit to the subchannel j for which 



is minimal, with ^^j^^^^ = "rj^^ + /3 and Vi ^ j = Tj-'^^ 

4) If Si ^i'^"'"^^ = terminate; otherwise k ^ k + 1 and go to step 3. 



The obtained allocation is then optimal 31 and solves (14). This algorithm needs iterations and its 



complexity is 0{nR). The target bit-rate R is supposed to be feasible, i.e. R is a. multiple of (3. Note that 
an equivalent formulation can be given starting with rf^^ = r^^x for all i and using bit-removal instead of 
bit-addition with maximization instead of minimization. For very high bit-rate, higher than |rmax, the number 
of iterations with bit-removal is lower than those obtained with bit-addition. This is the opposite with bit-rate 
lower than ^rmax- 

Iterative allocations have been firstly applied to bit-rate maximization under power constraint |13|. Many 
works have been devoted to complexity reduction of greedy- type algorithms, see for example [S], |14|, [32], 
[33] and references therein. In this section, only greedy-type algorithms are presented in order to compare the 
analytical allocation to the optimal iterative one. Note that analytical solution can also be used as an input 
of greedy-type algorithm to initialize it and reduce its complexity. 

A. System margin maximization 

The system margin, or system SNR-gap, maximization under bit-rate and peak-power constraints is the 
converse problem of the bit-rate maximization under SNR-gap and peak-power constraints. This converse 
problem has been solved, e.g., in j20]. To comply with the general problem formulation, the inverse system 
margin minimization is presented instead of the system margin maximization. 

Lemma 2: Under bit-rate and peak-power constraints, the greedy-type allocation that minimizes the inverse 



system margin 7 (16) allocates sequentially /3 bits to the subchannel i bearing bits and for which 



snri 

is minimum. 



Proof: It is straightforward using ([17| and (|28j). See Appendix |A] for an original proof. □ 
The main advantage of system margin maximization is that the optimal allocation can be reached in- 
dependently of the SNR regime. Allocation is always possible even for very low SNR but it can lead to 
unreliable communication with SNR-gap lower than 1. Lemma |2] is given with unbounded modulation orders. 



i-e. ^max = 00 and Vi E /3N. With full constraints (13), the subchannels that reach Tmax are simply removed 
from the iterative process. 
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TABLE I 

Example of system margin and BER with n = 20, R = 100, psdnr = 25 dB and /3 = 1. 





system margin 


BER 




maximization 


minimization 






(C) 


mm7i 

i 


6.9 dB 


6.6 dB 


ber 


3.1 • 10"^ 


2.6 • lO""^ 



B. BER minimization 

The system BER minimization under bit-rate and peak-power constraints is the converse problem of bit-rate 
maximization under peak-power and BER constraints. This converse problem has been solved, e.g., in |25|. 



Using (28) and (24), the solution of BER minimization is straightforward and the corresponding greedy- type 
algorithm is also known as Levin-Campello algorithm |7|, [34], [35]. The main drawback of this solution is that 
it requires good approximated BER expressions even in low SNR regime. This constraint can be relaxed and 
the following lemma gives the optimal greedy-type allocation for the BER minimization. 

Lemma 3: In high SNR regime and under bit-rate and peak-power constraints, the greedy-type allocation 
that minimizes the BER minimizes (r^ -|- [3)her i{ri + /3) at each step. 

Proof: See Appendix |B] □ 

Lemma |3] states how to allocate bits without mean BER computation at each step. It is given without 
modulation order limitation. Like system margin maximization solution, the bounded modulation order is 
simply taken into account using rmax and subchannel removal. 

C. Comparison of allocations 

To compare the two optimization policies, we call B the allocation that maximizes the system margin and 
C the allocation that minimizes the BER. Table |T] gives an example of bit-rate allocation over 20 subchannels 
where the SNR follows a Rayleigh distribution and with /3 = 1. In this example the PSDNR is equal to 
25 dB and the maximum allowed bit-rate per subchannel is never reached. As expected, the system margin 
minimization leads to a minimal SNR-gap, min^ 7^,, higher than that provided by the BER minimization policy 
with a gain of 0.3 dB. On the other hand, the BER minimization policy leads to BER lower than that provided 
by system margin minimization (2.6 • 10~^ versus 3.1 • 10~^). In this example, the dissimilarity is ^{B,C) = 0.1 
and two subchannels convey different bit-rates. All these results are obtained with r^ax = 10- 

This example shows that the difference between the two allocation policies is not so important. The question 
is whether both allocations converge and if they converge then in what case. The following theorem answers 
the question. 

Theorem 1: In high SNR regime with square QAM and under bit-rate and peak-power constraints, the 
greedy-type allocation that maximizes the system margin converges to the greedy-type allocation that mini- 
mizes the BER. 

Proof: See Appendix |D] □ 
The consequence of Theorem [T] is that the dissimilarity between allocation that maximizes the system margin 
and allocation that minimizes the BER is null in high SNR regime and with square QAM. With square QAM, 
P should be a multiple of 2. Note that with square modulations, /3 can also be equal to 1 if the modulations 
are, for example, those defined in ADSL 36 . Fig. [s] exemplifies the convergence with /3 = 2 as we will see 
later in Section IVTl 



V. Optimal analytical allocations 

The analytical method is based on convex optimization theory |37j. Unconstrained modulations lead to 
bit-rates defined in M. With G M+ the solution is the waterfilling one. With bounded modulation order, 
i.e. < ri < Tniax, the solution is quite different from the waterfilling one. The solution is obtained in the 
framework of generalized Lagrangian relaxation using Karush-Kuhn- Tucker (KKT) conditions j3^. 
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As the bit-rates are continuous and not only integers, the constraints ( 13 ) do not hold anymore and become 

(29) 



i=l 



R \/i < ri < 



The KKT conditions associated to the general problem (14) with (29) instead of (13) write 38 



-r-i < 0, Vz G [l,n] 
?^max < , Vi G [l,n] 



i=l 



d_ 
dr. 



-X- 





Mi > 0, Vz e [l,n] 

z^i > 0, Vi G [l,n] 

IXiTi = , Vz G [1, n] 

-Z^max) = 0, Vi G [l,n] 

/i,; + = , Vz G [1, n] 



(30) 
(31) 

(32) 

(33) 
(34) 
(35) 
(36) 

(37) 



The first three conditions (30)-(32) represent the primal constraints, conditions (33) and (34) represent the 
dual constraints, conditions (35) and (36) represent the complementary slackness and condition (37) is the 
cancellation of the gradian of Lagrangian with respect to r^. When the primal problem is convex, i.e. <p{{'ri\^^i) 
is convex and the constraints are linear, the KKT conditions are sufficient for the solution to be primal and 
dual optimal. For the system margin maximization problem, the function (/»(•) is convex over all input bit-rates 
and SNR whereas this function is no more convex for the BER minimization problem. Appendix [C] gives the 
convex domain of the function (/»(•) in the case of BER minimization problem. 
The properties of the studied function are such that 

d 



dri 



The optimal solution that solve (30)-(37) is then [38] 







^*(A) 



if x<Mo) 



^p-\x) if 4Ji{o) <x< ^,(w) 

?"max if A > V'i('^max) 



for all i G [1, ^^] and with A verifying the constraint 

Er*(A) 



R . 



(3^ 



(39) 



(40) 



i=l 



It is worthwhile noting that the above general solution is the waterfilling one if Tmax ^ R- The waterfiUing 
is also the solution in the following case. Let I' the subset such that Vi G I', r* ^ {0,rmax} and let R' the 
target bit-rate over I'. In this subset, {r*}i^x' are solutions of 



X 



R! 



E ^.(A) 



, Vi G X' 




(41) 



This is the solution of ( 14 ) with unbounded modulations over the subchannel index subset X'. If X' = {1, • • • ,72} 
and R' = R, (41) is also the solution of (14) with unconstrained modulations. 
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A. System margin maximization 

Theorem 2: Under bit-rate and peak-power constraints, the asymptotic bit allocation with unconstrained 
modulations which minimizes the inverse system margin is given by 

R 1 " snr- 

ViG[l,n], r*=— +-^log2 — - 
n n snr,- 
j=i ■' 

Proof: See Appendix |E] □ 
The solution given by Theorem [2] holds for high modulation orders which defines the asymptotic regime, 
cf. Appendix [E] As the modulations are unconstrained, the bit-rates {5^*}"=! are real numbers defined in M. 
With bounded modulation orders. Theorem [2] is used into (39) to solve (14) with constraints (29). If the set 



T' is known, then Theorem |2] can be used directly to allocate the subchannel bit-rates. Otherwise I' should 
be found first. 

The expression of r* in Theorem [2] is a function of the target bit-rate i?, the number n of subchannels and 
the ratios of SNR. This expression is independent of mean received SNR or PSDNR. It does not depend on 
link budget but only on relative distribution of subchannel coefficients {|/iip}"=i. 

B. BER minimization 



The arithmetic mean BER minimization has been analytically solved for example in 24 , 39 . This arithmetic 
mean measure needs to employ the same number of bits per constellation which limits the system efficiency. The 
following theorem gives the solution of the weighted mean BER minimization that allows variable constellation 
sizes in the multichannel system. 

Theorem 3: Under bit-rate and peak-power constraints, the asymptotic bit allocation with unconstrained 
QAM which minimizes the BER is given by 

VzG l,n, r* = - + - Y^^og^ — 

with equal in-phase and quadrature bit-rates. 

Proof: See Appendix |F] □ 
The solution given by Theorem |3] holds for high modulation orders and for subchannel BER lower than 
0.1, and these parameters define the asymptotic regime in this case, cf. Appendix |F] The optimal asymptotic 
allocation leads to square QAM with yjr* conveyed bit-rate in each in-phase and quadrature components of 
the signal of subchannel i. With bounded modulation orders. Theorem [s] is used in (39) to solve (14) with 



constraints (29). It is important to note that in asymptotic regime, BER minimization and system margin 



maximization lead to the same subchannel bit-rate allocation. In that case, the asymptotic regime is defined 



by the more stringent context which is the BER minimization. As we will see in Section VI this asymptotic 
behavior can be observed when (5 = 2. 

The main drawback of the formulas in Theorem [sjand Theorem [2]is that the bit-rates {r*}"^^ ^^'^ expressed 
in M and not in M+. To find the set X', the negative subchannel bit-rates and those higher than rmax should 



be clipped and X' can be found iteratively 20 . But clipping negative bit-rates first can decrease those higher 
than Tmax and clipping bit-rates higher than rmax first can increase the negative ones. It is then not possible 
to apply first the waterfiUing solution and after that to clip the bit-rates greater than r^ax to converge to 
the optimal solution. Finding the set X' requires many comparisons and we propose a fast iterative solution 
based on generalized secant method. 

C. Lagrangian resolution 



To solve (39 ), numerical iterative methods are required. It is important to observe that the function defined in 
(39) is not differentiable and thus, methods like Newton's cannot be used ^O]. We use the proposed generalized 
secant method to better fit the function-depending weight and increase the speed of the convergence. An 
important point for the iterative method is that the initialization must embrace all possible scenarios and 
should be as close as possible to the final solution. 
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Fig. 2. Approximation of input function /(A) with generalized secant method and secant method, n = 1024 and r-max = 15. 



The root of the function defined by (40) is now calculated. Let 

n 

f{\) = Y.^^{\)-R■ (42) 
i=l 

Theorems |2] and [3] show that r(A) is the sum of log2(-) functions. This is the reason why the function log2(-) 
is used in generalized secant method. Fig. [2] shows three functions versus the parameter A. The first function 
is the input function /(A), the second one is the function used by the generalized secant method, and the 
last one if the linear function used by the secant method. In this example, the common points are A = and 
A = 2.3. As it is shown, the generalized secant method better fit the input function than the secant method 
and therefore can improve the speed of the convergence to find the root which is around A = 1/80 in this 
example. 

To ensure the non empty root of the input function /(A), the secant methods should be initialized with 
Ai and A2 such as /(Ai) < and /(A2) > 0. For both optimization problems, system margin maximization 
and BER minimization, the parameter A is given by the function 'ipi{ri) and it can be reduced to A = as 
shown in appendices [E| and [F| Parameters {Ai,A2} are then chosen as 

Ai = and A2 = . (43) 

maxsnn mmsnn 

i i 

Using ( p9| ), A < Ai leads to ri{X) = for all i, and A > A2 leads to ri(A) = r^^x for all i. Then, it follows that 
/(Ai) < and /(A2) > if i? e (0, nw). 



14 




° 2000 4000 6000 8000 10000 12000 14000 

target bit-rate 



Fig. 3. Number of iterations of secant and generalized secant methods, and greedy-type algorithm versus the target bit-rate, 
n = 1024, rmax = 15. 

Fig. |3] shows the needed number of iterations for the convergence of the generahzed and conventional secant 
methods versus the target bit-rate R. Resuhs are given over a Rayleigh distribution of the subchannel SNR 
with 1024 subchannels. The possible bit-rates are then i? E [0,n x rmax] and /3 = 2. Here, Tmax = 15 and 
then R < 15360 bits per multidimensional symbol. For comparison, the number of iterations needed by the 
greedy-type algorithm is also plotted. Note that the greedy-type algorithm can start by empty bit-rate or by 
full bit-rate limited by r^^x for each subchannel. The number of iterations is then given by mm{R, nrmax — 
The iterative secant and generalized secant methods are stopped when the bit-rate error is lower than 1. A 
better precision is not necessary since exact bit-rates {r^jigi/ can be computed using Theorems [2] and [s] when 
I' is known. As it is shown in Fig. |3| the generalized secant method converges faster than the secant method, 
except for the very low target bit-rates R. For very high target bit-rates, near from n x rmax, generalized 
secant method can lead to a number of iterations higher than those of greedy-type algorithm. Except for these 
particular cases, the generalized secant method needs no more than 4-5 iterations to converge. In conclusion, 
we can say that with Rayleigh distribution of {snri}"^^, the generalized secant method converges faster than 
secant method or greedy- type algorithm for target bit-rate R such that 3% < ^ < 97%. 

Using generalized secant method the bit-rates are not integer and for all i, r* G [0,rmax]- These solutions 
have to be completed to obtain integer bit-rates. 

D. Integer-bit solution 

Starting from continuous bit-rates allocation previously presented, a loading procedure is developed taking 
into account the integer nature of the bit-rates to be allotted. A simple solution is to consider the integer part 
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of {r*}igi/ and to complete by a greedy-type algorithm to achieve the target bit-rate R. The integer part of 
{r*}igx' is then used as a starting point for the greedy algorithm. This procedure can lead to a high number 
of iterations, therefore the secant or bisection methods are suitable to reduce the complexity. The problem to 
solve is then to find the root of the following function |2(? 

gia) = Y,[r* + M-R', (44) 

where r*, I' and R' are given by the continuous Lagrangian solution. This is a suboptimal integer bit-rate 
problem and the optimal one needs to find instead of a unique a. As the optimal solution leads to a 



huge complexity, it is not considered. The function (44) is a non decreasing and non differentiable staircase 



function such that g{0) < 0, g{l) > because J2iei' """t ~ ^' ■ ^^^'^ iterative methods can then be initialized 
with ai = and 02 = 1. 

Two iterative methods are compared, the bisection one and the secant one. Both methods are also compared 
to the greedy-type algorithm. Fig. [4] presents the number of iterations of the three methods to solve the 
integer-bit problem of the Lagrangian solution with (3=1. Results are given over a Rayleigh distribution of 
the subchannel SNR, with 1024 subchannels and the target bit-rates are between and n x rmax = 15360. As it 
is shown, the convergence is faster with bisection method than with greedy-type algorithm. For target bit-rates 
between 10% and 90% of the maximal loadable bit-rate, the secant method outperforms the bisection one with 
a mean number of iterations around 4 whereas the number of iterations for bisection method is higher than 8. 
Fig. [Ijalso shows that \g{0) \ is all the time lower than the half of number of subchannels and around this value 
for target bit-rate between 10% and 90% of the maximal loadable bit-rate. Then, if the complexity induces 
by the greedy-type algorithm to solve the integer-bit problem of the Lagrangian solution is acceptable in a 
practical communication system, this greedy-type completion can be used and leads to the optimal allocation. 
This result obtained without proof means that the greedy-type procedure has enough bits to converge to the 
optimal solution. If the number of iterations induced by the greedy-type algorithm is too high (this number 
is around n/2), the secant method can be used. 



The overall analytical resolution of (14) needs few iterations and its complexity is 0{n) instead of 0{Rn) for 



the optimal greedy-type algorithm. Whereas the continuous solution of (14) is optimal, the analytical integer 
bit- rate solution is suboptimal. 



VL Greedy-type versus analytical allocations 

In the previous section, algorithm complexities have been compared. In this section, robustness comparison 
is presented and the analytical solutions obtained in asymptotic regime are also applied in non asymptotic 
regime which means that (3=1 and modulation orders can be low. 

Fig. [5] presents the output BER and the system margin of three allocation policies versus the target bit-rate 
R. The first one. A, is obtained using analytical optimization, the second, B, is the solution of the greedy-type 
algorithm which maximizes the system margin and the third, C, is the solution of the greedy- type algorithm 
which minimizes the BER. Two cases are presented, one with (3=1 and the other with (3 = 2. All subchannel 
BER are lower than 2 • 10~^ to use valid BER approximations. To compare the case (3 = 1 with the case 
(3 = 2, Tinax is cqual to 14. Results are given over a Rayleigh distribution of the subchannel SNR, with 1024 
subchannels. Note that with (3=1, the system margin of allocation B is almost equal to 8.9 dB for all target- 
bit rates. This constant system margin 7 is not a feature of the algorithm but is only a consequence of the 
relation between the target bit-rate and the PSDNR. 

To enhance the equivalences and the differences between the allocation policies, the dissimilarity is also 
given in Fig. [5] with (3 = 1 and /3 = 2. As expected and in both cases (3 = 1 and (3 = 2, the minimal BER are 
obtained with allocation C, and the maximal system margins with allocation B. With (3 = 1 and when the 
target bit-rate increases, the Lagrangian solution converges faster to the optimal system margin maximization 
solution B than to the optimal BER minimization solution C. Note that Theorem [3] is an asymptotic result 
valid for square QAM. With (3=1, the QAM can be rectangular and the asymptotic result of Theorem |3] 
is not applicable, contrary to the result of Theorem |2] where there is not any condition on the modulation 
order. With (3 = 2, the modulation granularity is lower and then the output BER are higher than those 
obtained with /3 = 1, as the output system margins are lower than those obtained with (3 = 1. This case 
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Fig. 4. Number of iterations of bisection and secant methods, and greedy-type algorithm for integer-bit solution versus target 
bit-rate, n = 1024, rmax = 15. 



[5 = 2 shows the equivalence between the optimal system margin maximization allocation and the optimal 
BER minimization allocation. In this case, the asymptotic result given by Theorem [T] and |3] can be applied 
because the modulations are square QAM, and the convergence is ensured with high modulation orders, i.e. 
high target bit-rates. Beyond a mean bit-rate per subchannel around 10, that corresponds to a target bit-rate 
around 10^, all the allocations B and C are equivalent and the dissimilarity is almost equal to zero. In 
non asymptotic regime, the differences in BER and system margin are low. The system margin differences are 
lower than 1 dB, and the ratios between two BER are around 3. In practical integrated systems these low 
differences will not be significant and will lead to similar solutions for both optimization policies. Therefore, 
these allocation can be interchanged. 



VII. Application: DMT for power line channel 
All previous results are presented over Rayleigh distribution of subchannel SNR. This distribution can occur 



in PLC channel 40 but distribution with higher SNR range is also possible |41j. The robustness is evaluated in 
harsh condition and the model proposed in [4l] is then chosen. Fig. [g] shows the frequency response of 15 paths 
PLC model in [0.5; 20] MHz bandwidth where the subchannels undergo more than 60 dB SNR range. In PLC 
systems, the subchannels are the subcarriers of the multicarrier system and the PLC communication system 
uses 1024 subcarriers, Tmax = 15 as in xDSL communication systems and /3 = 1. All QAM constellations 
between 4-QAM to 32768-QAM plus BPSK are used. Note that with 60 dB of SNR range, there are possible 
= and rj = 15 in the same multicarrier symbol since around 45 dB of SNR range is sufficient to have 
both = and Vj = 15 in the same multicarrier symbol. The robustness measures are evaluated for different 
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Fig. 5. BER, system margin and dissimilarity versus target bit-rate for Lagrangian (A), greedy-type system margin maximization 
(B) and greedy-type BER minimization (C) algorithms, n = 1024, rmax = 14, /3 e {1,2}. 



target bit-rates which are given with the foUowing arbitrary equation 



R 



(45) 



_i=l 

This equation ensures rehable communications for ah the input target bit-rates or PSDNR. The empirical 
relationship between PSDNR and target bit-rate is also given in Fig. [6] 

Fig. [7] sums up the characteristics and the results of three allocation policies in PLC context. The first 
allocation, A, is obtained using analytical optimization developed in Section |Vj the second, B, is the solution 
of the greedy-type algorithm given by Lemma [2] which maximizes the system margin and the third, C, is 
the solution of the greedy-type algorithm given by Lemma [3] which minimizes the BER. In this figure, the 
BER, the system margin in decibel and the needed number of iterations are plotted versus the input target 
bit-rates, subfigure (a), (b) and (c) respectively. The subfigure (d) gives the dissimilarity measure versus the 
mean bit-rate per subchannel which is equal to R/n. In subfigure (a) the minimal BER is obtained with 
allocation C, as expected. The allocation A offers the worse BER with a maximal ratio of 2 compared to 
the best result. For high bit-rates this ratio converges to 1. In subfigure (b) the maximal system margin is 
given by allocation B, as expected,. The maximal difference between allocations B and C is around 3 dB. 
The number of iterations needed with Lagrangian method, allocation A, is very low compared with optimal 
greedy-type ones, allocations B and C. Subfigure (c) shows that only 20 iterations are sufficient for most cases 
to perform allocation with method A, when up to 7680 iterations are needed with greedy- type algorithms. 
This maximal number of iterations is given by ^Tniax- The dissimilarity, subfigure (d), is very high for low 
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Fig. 6. Frequency response of 15 paths PLC model |41| versus frequency and target bit-rate versus input PSDNR. 

mean bit-rate per subchannel. When the mean number of bits per constehation is low, the asymptotic results 
do not hold. This dissimilarity decreases with the increase of the mean bit-rate per subchannel where the 
asymptotic results become valid. Note that as the PSDNR varies with the target bit-rate, the BER curves are 
not simply decreasing and the system margin curves are not simply increasing with the increase of the target 
bit-rate. 

All these results show that the allocation A based on Lagrangian method converges faster to allocation B 
(than to allocation C) when the bit-rate increases. In communication systems with /3 = 1, the asymptotic 
conditions of analytical solution of minimal BER problem do not hold. Nevertheless, the difference between 
allocations A and C remains low. The system margin differences are up to 3.5 dB, and the BER ratios are up 
to 2.2. The allocation policy should then be selected depending on the considered robustness measure. 

Fig. [5] and [7j and complementary simulations not presented here, show that the system margin difference 
between two allocation policies increases when the average value of the system margin decreases, whereas the 
BER difference, or ratio, between two allocation policies decreases when the average value of system BER 
increases. With optimized uncoded systems, the case presented in Fig. [7] is generally considered for operating 
points which correspond to higher BER. Both allocation policies then lead to similar BER performance but 
lead to significantly different system margin performance. 

Fig. [S] gives an example of bit-rate distribution between subchannels with an input bit-rate of 6030 bits 
per multicarrier symbol which corresponds to a PSDNR of 40 dB. All the bit-rate distributions follow the 
shape of the PLC channel frequency response and exhibit some variations. In this example, the system margin 
of the allocation A is close to the optimal one, and is between the system margin of the two greedy-type 
solutions. Allocation A offers the highest BER but only 1.2 times higher than the optimal BER. The main 
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Fig. 7. (a) BER, (b) system margin versus target bit-rate for Lagrangian (A), greedy-type system margin maximization (B) and 
greedy-type BER minimization (C) algorithms, (c) iteration number of Lagrangian solution and greedy-type algorithms versus 
target bit-rate, and (d) dissimilarities ^{A,B), fi{A,C) and ^{B,C) versus mean bit-rate per subchannel, n = 1024, rmax = 15. 
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A, BER = 2.3e-03, system margin = 2.7 (dB) 

B, BER = 2.1e-03, system margin = 3.0 (dB) 

C, BER = 1.9e-03, system margin = 1.7 (dB) 



Li 
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subcliannel index 

Fig. 8. Example of bit-rate allocation versus subchannel index for Lagrangian (A), greedy-type system margin maximization 
(B) and greedy-type BER minimization (C) algorithms, n = 1024, rmax = 15, psdnr = 40 dB, R = 6030. 

difference between allocations B and C is the distribution of even and odd number of bits per constellation. 
With allocation B there are almost as many odd elements as there are even, whereas allocation C favors even 
elements. This behavior of allocation C is exemplified in Fig. [8] with = 4 and subchannel index i around 
600 and 800, or with = 8 and i around 400. The explanation is given by the BER curves in Fig. [T] where 
the distance between two curves depends on the parity of the number of bits per constellation. The distance 
between the curves corresponding to = 3 and = 4 is lower than the distance for the case = 4 and = 5. 
Then, for the same slope of the input frequency response function, the staircase function of the allocation C 
in Fig. |8] has larger step size when the numbers of bits per constellation are even. 

All these results in PLC context show that both allocation policies, system margin maximization and BER 
minimization, lead to different bit-rate allocations. These unique allocations have significant system margin 
difference whereas the BER difference between these allocations is very low. The suboptimal analytical solution 
based on Lagrangian offers a good trade-off between performance and complexity. With channel coding, not 
taken into account in this paper, the analysis remains valid: the ultimate output coded BER is strongly related 
to the uncoded BER, and the system margin optimization is independent of channel coding type. 

VIIL Conclusion 

Two robustness optimization problems have been analyzed in this paper. Weighted mean BER minimization 
and minimal subchannel margin maximization have been solved under peak-power and bit-rate constraints. 
The asymptotic convergence of both robustness optimizations has been proved for analytical and algorithmic 
approaches. In non asymptotic regime the allocation policies can be interchanged depending on the robustness 
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measure and the operating point of the communication system. We have also proved that the equivalence 
between SNR-gap maximization and power minimization in conventional MM problem does not hold with 
peak-power limitation without additional conditions. Integer bit solution of analytical continuous bit-rates 
has been obtained with a new generalized secant method, and bit-loading solutions have been compared with 
a new defined dissimilarity measure. The low computational effort of the suboptimal solution, based on the 
analytical approach, leads to a good trade-off between performance and complexity. 



Appendix A 
Proof of Lemma [2] 

We prove that the optimal allocation is reached starting from empty loading with the same intermediate 
loading than starting from optimal loading to empty loading. To simplify the notation and without loss of 
generality, /3 = 1. 

Let [rl, - ■ ■ ,r*] be the optimal allocation that minimizes the inverse system margin ^{R*)~^ for the target 
bit-rate R*, then 

= max . (46) 

Let [ri, • • • , r„] be the optimal allocation that minimizes the inverse system margin 'y{R+ for the target 
bit-rate R+1 < R*. The optimal allocation for target bit-rate R is obtained iteratively by removing one bit 



at a time from the subchannel k with the highest inverse system margin 42 



or 



2'"' — 1 

k = argmax (47) 

i snri 

2'"k — 1 2^' — 1 

yi £ \l,n] > . (48) 

snr^ snri 

The last bit removed is from the subchannel with the lowest inverse-SNR, snr~^, because the bits over the 
highest inverse-SNR are first removed. 

Now, let [ri,--- , r„] be the optimal allocation that minimizes the inverse system margin ^{R)~^ for the 
target bit-rate R < R*. Following the algorithm strategy, the optimal allocation for target bit-rate i? -|- 1 is 
obtained adding one bit on subchannel j such that 

2n+i _i 

j = argmin . (49) 

i snr^ 



We first prove that 



Suppose there exists j' such that 



2rj+l _ 

j{R+l)-^ = . (50) 



snr^ 



1 2'''+i - 1 

- > —ZT. ' (51) 



then one bit must be added to subchannel j to obtain rj + 1 bits before adding one bit to subchannel j' to 
obtain Vj' bits which means that [ri, • • • ,r„] is not optimal. As [^i, • • • ,r„] is optimal by definition, it yields 

2^ _ I 2^-'^^ — 1 

Vz G \l,n] < (52) 

snri snrj 



which proves (50). The first allocated bit is from the subchannel with the lowest inverse-SNR given by (49) 
with Ti = for all i. 



Comparing (48) with (52) yields that k = j, and the index subchannel of the first added bit is the same 
as the last removed bit. All the intermediate allocations are then identical with bit-addition and bit-removal 
methods. There exists only one way to reach the optimal allocation R* starting from the empty loading. 

Proof of Lemma |2] can also be provided in the framework of matroid algebraic theory [2l] , 43 . 
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Appendix B 
Proof of Lemma [3] 

To simplify the notation and without loss of generality the proof is given with (3 = 1. Let [^i, • • • ,r„] be 
the optimal allocation for the target bit-rate R such that ^ = i?. Let R + 1 the new target bit-rate. We 
first prove that Ai{ri) = [ri + l)heri{ri -I- 1) — riheri[ri) is a good measure at each step of the greedy-type 
algorithm for the BER minimization, and finally that (r^ + l)beri(ri -|- 1) can be used instead of Ai(ri). 

Starting from the optimal allocation of target bit-rate i?, the new target bit-rate ii -|- 1 is obtained by 
increasing rj by one bit 

n 

{vj + l)berj(rj + 1) + J^^riberiin) 
ber(i? + 1) = (53) 

i=l 



and, using Aj, 



ber{R + 1) = Mi) + ^ber(i?) . (54) 



The ber(i?,+ l) which is equal to <f>{{rl }i=i) in (28) is minimized only if Aj{rj) is minimized. The minimum 
ber(i?+ 1) is then obtained with the increase of one bit in the subchannel j such that 

j = argmin Ai(ri) . (55) 

i 

To complete the proof by induction, the relation must be true for ber(l). This is simply done by recalling 
that beri(O) = 0, and then 

minber(l) = minberi(l) = minAi(O) . (56) 

i i 

The convergence of the algorithm to a unic|ue solution needs the convexity of the function r,; riher{ri). This 
convexity is verified at high SNR. Appendix [C] provides a more precise domain of validity. 

It remains to prove that (r^ -f- l)beri(ri + 1) can be used instead of Ai{ri). In high SNR regime 

beriin + 1) > ber,(r,) (57) 

and then 

lim A,{ri) = {n + l)beri(ri + 1) (58) 

which proves the lemma. 

In lower SNR regime, the approximation of A^, by (r^ + l)beri(ri + 1) remains valid and, in practice, the 
dissimilarity between allocation using A,; and allocation using (r^ -\- l)heri{ri + 1) is null in the domain of 
validity given by appendix [C] 

Appendix C 
Range of convexity of Tiber i 

Let 

/: N^M+ (59) 
ri riberi(ri,snri) 

which equals the SER for high SNR regime and Gray mapping. The function / is a strictly increasing function: 
Vsnri, f{ri) < /{u + 1) because ber(ri,snri) < ber(ri + l,snri) and u < ri + 1. Let A{ri) = f{ri + I) - f{ri), 
then 

A{ri + 1) - Ain) = f{r, + 2) - 2/(r, + 1) + /(r,) (60) 
> {ri + l)(ber,(ri + 2) - 2ber,(ri + 1)) 

If beri(r,; + 2) > 2ber,:(ri -I- 1) then the function / is locally convex, or defines a convex hull. This relation is 
verified for BER lower than 2 x 10~^ and for all r,' > 0. 
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Appendix D 
Proof of Theorem [T] 

We prove that both metrics used in Lemmas [2] and |3] lead to the same subchannel SNR ordering. Let 

2ri+l3 _ -j^ 

/(ri,snri) = (61) 

snrj 

and 

g{r„ smi) = (r, + /3)beri(r, + /3) . (62) 

We then have to prove that 

f{ri, snvi) < f{rj, smj) <^ giu, snr^) < g{rj, smj) . (63) 

The first inequality yields 

snro 2''^+'^ - 1 

— - < ^ ■ (64 



With square QAM, in high SNR regime and using (26) 



q(ri,smi) = 2 ( 1 , ^ ] erfc ( . / — ^ ^snr^ | (65) 

' * V2^J I V 2(2'-'+/5 - 1) 7 ^ ^ 



and it can be approximated by the following valid expression in high SNR regime 

I ^ 
2(2'^»+/3 - 1) 



g{ri, smi) = 2 erfc ( J -—^ TTS"''^)- (^6) 



The second inequality of (63) then leads to 

snr,- 2'-^+^-l 

which is also given by the first inequality. In high SNR regime and with square QAM, i.e. /9 = 2, /(•) and g{-) 
lead to the same subchannel SNR ordering and then 

argmin/(ri,snri) = argmin5'(ri,snri) . (68) 

i i 

This last equation does not hold in low SNR regime (the BER approximation is not valid) or when the 
modulations are not square, i.e. when is odd. Note that ( [66^ is not only a good approximation in high 
SNR regime, it can also be used with high modulation orders with moderate SNR regime as it is defined in 
Appendix |C] 

Appendix E 
Proof of Theorem [2] 

As the infinite norm is not differentiable, we use the k norm with 

1 

n 

hin (E^r') =max(7-i). (69) 

1=1 



With unconstrained modulations, the Lagrangian of (18) for all k is 



Let A' such as 



vJ = l * / \ 1=1 



fc-1 



snrf / log2 ^ ' 



\i=\ 
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The optimal condition yields 

2^(2'-. =snrfA'. (72) 

In asymptotic regime, ^ 1 and then 2*^' — 1 ~ 2''\ The equation of the optimal condition can be simplified 
and 

ri = log2(snri) + ilog2 A' . (73) 

The Lagrange multiplier is identify using the bit-rate constraint, and replacing A' in the above equation leads 
to the solution 

R I snri 

ri = - + -2^ loga • (74 

n n ~ snr,- 

Note that we do not need to calculate the convergence of the solution with k — )• +00 to obtain the result for 
the infinite norm. The result holds for all values of k in asymptotic regime. 

With k = 1, the problem is a sum SNR-gap maximization problem under peak-power constraint and it can 
be solved without asymptotic regime condition. Note that this sum SNR-gap maximization problem, or sum 
inverse SNR-gap minimization problem, under peak-power and bit-rate constraints is 

minf:7-^= nnn ±{r^-l)j^^ (75) 

and is very similar to power minimization problem under bit-rate and SNR-gap constraints exchanging pi with 

n n 2 

rnmY^P.= rainY^i^'^-l)—^. (76) 

i=l i'^'h=i i=i I /ill ^li 

Both problems are identical if piji = a as it is stated by Lemma [T] 

Appendix F 
Proof of Theorem [3] 

To prove this theorem, variables li and Ji are used instead of and the bit-rate constraint is 



i=l 



With unconstrained QAM, the Lagrangian of (25) is then 

^((^.^)t..A)4i:(2 -i-i) 



-l-A i?-^log2(/iJ.) . (75 



i=l 



Let Xi £ {/j, Ji}, then 



dL 1 1 

— = XJ{Ii, J,) + ^g(/„ Ji) - —A , (79) 



with 



, if 1 1 \ 2v/3snr^ x e 't+'t-^ ^ ^ 
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and 



g{Ii, Ji) = ;^erfc 



3sn r,' 



I + J -2 



The optimality condition yields 

(/f - Jf)hJ^f{h, Ji) = [h - JMh, Ji) 

A trivial solution is li = Ji and the other solution must verify 

{h + J,)hJif{h,Ji)-g{Ii,J,) = 0. 



To find the root of (83), let 



with 



h{x, y) = x^/ye ^ - erfc {^) 
2 {Ii + Ji)IiJ, 



and 



^n + jf-2 



3snr^ 



We will prove that this function is positive in a specific domain. 

1) ■s/ye~y > erfc (y/y) for y > 0.334, then for BER lower than 10~^. 

2) ^x>l for {li, JJ G [1, +cx))2 and /, ^ 1 or 7^ 1, and lim ^x = 1+. 

Then, in the domain defined by 

{I^,J^} G [l,+oo)2 A ber, < 0.1 



(81) 

(82) 
(83) 
(84) 

(85) 
(86) 



^7) 



h{x,y) is positive and (83) has no solution. Thus, the only one solution of (82) with (87) is li = Ji. As we 
will see later the domain of (87) is less restrictive than the asymptotic one. 

The problem is now to allocate bits with square QAM. The following upper bound is used 



ber(ri) = — erfc 

Ti 



I 3snri 

2(2'-= - 1) 



Note that this upper bound is a tight approximation with high SNR and with high modulation orders. The 
Lagrangian is 



^({n}r=i,A) = -^E^rfc 



3snri 



i=l 



2(2'-' - 1) 



and its derivative is 



_ In 2 2'' 

dri 



3snr,- ^""^i 

-e 2(2'-.-i) _ ;\ , 



/vr 2'-' - 1 y 2(2'-' - 1) 
Let Vi r, ^ 1, then 2*"' — 1 ~ 2'"' and the optimality condition yields 



3Snri 3snr, 
e 2''i 



2A^7r 
'h?2 



(90) 



(91) 
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With reliable communication over the subchannel i, the Shannon's relation states that < log2(l + snri) and 
^^^r — 1 because > 1. The relation between and A is then bijective and the real branch W-i of the 



Lambert function f44l can be used with no possibility for confusion 



n = log2(3snri) - loga |^-VF-i 
With the bit-rate constraint R = ^ri, we can write 



2A^7r 



(92) 



-log2 -W-i 



2W 



— - -y]log2(3snri 

n n ^ 

1=1 



and with (92) 



R 1 snr^ 

- + - 2^ log2 

n n ~ snr,- 



(93) 



(94) 



This result is obtained with square QAM in asymptotic regime (high modulation orders and high SNR) which 
is a more restrictive domain than that of (87). 
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